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Abstract. In this paper we study subsequences of random numbers. 
In Kamae (1973), selection functions that depend only on coordinates 
are studied, and their necessary and sufficient condition for the selected 
sequences to be normal numbers is given. In van Lambalgen (1987), an 
algorithmic analogy to the theorem is conjectured in terms of algorithmic 
randomness and Kolmogorov complexity. In this paper, we show different 
algorithmic analogies to the theorem. 

1 Introduction 

In this paper we study subsequences of random numbers. A function from se- 
quences to their subsequences is called selection function. In Kamae [5] selection 
functions that depend only on coordinates are studied, and their necessary and 
sufficient condition for the selected sequences to be normal numbers is given. In 
the following we call the theorem Kamae- Weiss (KW) theorem on normal num- 
bers since a part of the theorem is shown in Weiss [TS] . In van Lambalgen [T3] , 
an algorithmic analogy to KW theorem is conjectured in terms of algorithmic 
randomness and complexity |2I7I9I11] . In this paper we show two algorithmic 
analogies to KW theorem. 

Let SI be the set of infinite binary sequences. For x, y G SI, let x — x\X2 ■ ■ ■ 
and y = y\y2 ■ • • , Vi %i } yi G {0, 1}. Let t : N -> N be a strictly increasing 
function such that {i | y t = 1} = {r(l) < r(2) <■••}. If J2i yi = n then r(j) is 
defined for 1 < j < n. For x,y G SI let x/y be the subsequence of x selected at 
yi = 1, i.e., x/y = x T ^x T (2) ■ ■ •■ For example, if x = 0011 • • • , y — 0101 • • • then 
t(1) = 2,t(2) = 4 and x/y — 01 • • ■. For finite binary strings x\ := x\ ■ ■ ■ x n 
and : — Vi " ' 'Un, x™/yi is defined similarly. Let S be the set of finite binary 
strings and \s\ be the length of s £ S. For s G S let A(s) :— {so;|o; G SI}, where 
suj is the concatenation of s and uj. Let (SI, B, P) be a probability space, where 
B is the sigma-algebra generated by A(s), s G S. We write P(s) := P(A(s)). 

In Kamae [5], it is shown that the following two statements are equivalent 
under the assumption that liminf — Y^i=i S/i > 0: 

Theorem 1 (KW). 

(i) h{y) = 0. 

(ii) Vx G Af x/y G J\f, 

where h(y) is Kamae entropy U}13f and J\f is the set of binary normal numbers. 



A probability p on f2 is called cluster point if there is a sequence {rii} 
Vs G S p(s) = lim #{1 < j < rii | Xj ■ ■ ■ aj,- + ui_i = sj/rij. 

i— >oo 

From the definition, the cluster points are stationary measures. Let V(x) be 
the set of cluster points defined from x. From a standard argument we see that 
V(x) ^ for all x. Kamae entropy is defined by 

h(x) = sup{h{p) | p G V(x)}, 

where h(j>) is the measure theoretic entropy of p. If h(x) = 0, it is called com- 
pletely deterministic, see |5I15I16) . The part (i)=> (ii) is appeared in [15] . 

As a natural analogy, the following equivalence (algorithmic randomness ver- 
sion of Kamae's theorem) under a suitable restriction on y is conjectured in van 
Lambalgen [13] . 

(i) lim n ^ oo K(y?)/n = 0. 

(ii) Vx G K x/y G K, 

where K is the prefix Kolmogorov complexity and TZ is the set of Martin-Ldf 
random sequences with respect to the uniform measure (fair coin flipping), see 
[8 . Note that lim, woo if(y™)/n = h,P — a.s., for ergodic P and its entropy h, 
see PQ. 

2 Results 

In this paper, we show two algorithmic analogies to KW theorem. The first 
one is a Martin-L6f randomness analogy and the second one is a complexity 
rate analogy to KW theorem, respectively. In the following, P on Q is called 
computable if there is a computable function A such that Vs, k \P(s) — A(s, k)\ < 
1/k. For A C S, let A :— U se A A(s). A recursively enumerable (r.e.) set U C NxS 
is called (Martin-L6f) test with respect to P if 1) U is r.e., 2) C/„+i C U n for all 
n, where U n = {s : (n, s) G U}, and 3) P(U n ) < 2 _ ™. A test U is called universal 
if for any other test V, there is a constant c such that Vn V n+C C £/„. In [5], it is 
shown that a universal test C/ exists if P is computable and the set (r\^ =1 U n ) c 
is called the set of Martin-L6f random sequences with respect to P. 
Our first algorithmic analogy to the KW theorem is the following. 

Proposition 1. Suppose that y is Martin-Ldf random with respect to some com- 
putable probability P and y^._ 1 yi = oo. Then the following two statements are 
equivalent: 

(i) y is computable. 

(ii) Vx eTZ x/y G ll y , 

where lZ y is the set of Martin-Ldf random sequences with respect to the uniform 
measure relative to y. 

Proof) (i)=> (ii). Since YliLi Vi = oo we have Vs \{x G fl \ s C x/y} — 2~l s l, 
where A is the uniform measure. Let U be a universal test with respect to A 
and y(s) C S be a finite set such that {x G ft \ s C x/y} — y(s). Then y(s) is 



computable from y and s, and hence U y := {(n,a) | a G y(s), s G t/„} is a test 
if y is computable. We have x G U-( x/y & U„ . (Intuitively U v is a universal 
test on subsequences selected by y). Then 

ieK->i^ n„£/^ «-> x/y ^ n n {7„ o x/y e 7?.. 

Since y is computable, 7\L y = 1Z and we have (ii). 

Conversely, suppose that y is a Martin-L6f random sequence with respect to 
a computable P and is not computable. From Levin-Schnorr theorem, we have 

Vn Kmffl) = -logP(^) + 0(1), (1) 

where Km is the monotone complexity. Throughout the paper, the base of loga- 
rithm is 2. By applying arithmetic coding to P, there is a sequence z such that z 
is computable from y and y" C w(^[ n ), i n = — logP(y")+0(l) for all n, where u 
is a monotone function and we write s \Z s' if s is a prefix of s'. Since y is not com- 
putable, we have lim n l n — oo. From |T]), we see that Vn Km(z[ n ) = l n + 0(1). 
We show that if y G 1Z then sup„ l n +i ~ hi < oo. Observe that if y G TZ then 
Vn P(y?) > and 

sup^+i - /„ < oo o sup - logP(y„+i | y") < oo O inf P(y„+i | y") > 

n n n 

o liminf P(y„+i | y") > 0. 

n 

Let t/„ := {s | P(s | s^ hl ) < 2~' 1 }. Then P(f/„) < 2~ n and U := {(n,s) | s G 
£/„} is a r.e. set. Since y G limsup n U n -H- liminf n P(y„ + i | y") = 0, if y G 7\L then 
sup„^„+i — l n < oo. (If U is r.e. and P(C/„) < 2~ n then 7?. C (limsup„ U n ) c , 
see [ID]-) Since Vn Km(z[ n ) — l„ + 0(1) and sup„ — l n < oo, we have 
Vn i^m(z") = n + 0(1) and z E 1Z. Since z is computable from y we have 
z/y <£ W. □ 

Note that if y is computable then y is a Martin-L6f random sequence with 
respect to a computable measure that has positive probability at y. 

In order to show the second analogy, we introduce another notion of random- 
ness. We say that y has maximal complexity rate with respect to P if 

lim -K(y^)= lim -ilogP(^), (2) 

n— ^oo TL n— >oo Ji 

i.e., both sides exist and are equal. For example, y has maximal complexity rate 
with respect to the uniform measure (i.e., P(s) = 2~l s l for all s) if 
linin^oo K(yi)/n = 1. If y is Martin-L6f random sequences with respect to a 
computable ergodic P then from upcrossing inequality for the Shannon-McMillan- 
Brciman theorem [4], the right- hand- side of ([2]) exists (see also [14]) and from 
(JlJ, we see that @ holds i.e., y has maximal complexity rate w.r.t. P. 

Proposition 2. Suppose that y has maximal complexity rate with respect to a 
computable probability and lim„ i X)"=i 2/* > ^- P/ien t/ie following two state- 
ments are equivalent: 

(i) lim™ ±K(y?) = 0. 

(ii) Vx lim^oo iif(^) = 1 -> lim™ 1 - f i-^^(x«/y«|j / «) = 1. 



Proof) 
(0=>(ii) 

Let y := 2/i?/2 • • • £ fi such that yi — 1 if yi — and y,; — else for all i. Since 
\K( X ?)-K(x?\y?)\<K(y?) + 0(l) 

and 

K(x n M) = K(x n 1 /y?,x n 1 /y?\ y ?) + 0(l), 
if lirrin^oo K(yi )/n = and < lim„ — Y^7=i f» < then we have 
lim K(xl)/n = 1 

n— >oo 

=> lim i^KV 2/ », 2 ;»M%n = l 

=> lim -(tf^/tfltf) + (x?/y?|y™)) = 1 

l im !^J_^ (:E » / y«|y ? ) + n ~ ni 1 iC^/y^y?) = 1 
n->oo u m n n-fii 

=> lim — ^(xy/yriy?) = 1 and lim -J—Kffl/iff\tf) = 1. 

where m = \x"/y"\ = 12™=i Similarly, if lim„-».oo K(y")/n = and 
lim„ i £)" =1 y< = 1 then we have lim^oo i-K" (a? = 1- 

(ii) (i) 
Suppose that 

lim -X(y?) = lim --logP(y?) > 0, (3) 

n— >oo fi n—¥oo n 

for a computable P. Let l n be the least integer greater than — logP(y"). Then by 
considering arithmetic coding, there is z = z\Z2 ■ ■ ■ S fi and a monotone function 
u such that y™ C By considering optimal code for z[ n we have Km(yi) < 

Km(z[ n ) + 0(1). From we have lim„ Km(y[ l )/l n = lim„ Km(z[ n )/l„ = 1. 
For l n < t < l n +i, we have Km(z l 1 n )/l n +i < Km(z t 1 )/t < Km(z l j n+1 )/l n . From 
((3]), we have lim„ l n +i/l n = 1, and hence lim„ Km(z™) /n = lim„ K(zf)/n = 1. 

Since 1) is computable from y™, 2) lim« l n /n > by (J3]), and 
3) lim„ i £™ =1 y* > 0, we have limsup^^ p*j^ K(z?/y?\y?) < 1. □ 

Example 1. Champcrnowne sequence satisfies the condition of the proposition 
and (i) holds, however its Kamae-entropy is not zero. 



Example 2. If y is a Sturmian sequence generated by an irrational rotation model 
with a computable parameter |6|12j then y satisfies the condition of the propo- 
sition and (i) holds. 



3 Discussion 



Both proofs of Proposition 1 and 2 have similar structure, i.e., the part (i) — > 
(ii) are straightforward and in order to show the converse, we construct random 
sequences (in the sense of Proposition 1 and 2, respectively) by compression. 

We may say that Proposition 1 is a Martin-L6f randomness analogy and 
Proposition 2 is a complexity rate analogy to KW theorem, respectively. These 
results neither prove nor disprove the conjecture of van Lambalgen. However 
Martin-L6f randomness and complexity rate randomness give different classes of 
randomness, and a curious point of the conjecture is that it states equivalence 
of statements described in terms of them. 

As stated above we proved our propositions by constructing random se- 
quences. In [3J pp.962, a different direction is studied, i.e., a sequence that is 
not predicted by MML with respect to finite order Markov processes is consid- 
ered. Such a sequence is called red herring sequence [3J and considered to be a 
non-random sequence with respect to MML and finite order Markov processes, in 
the sense that MML cannot find a finite order Markov model for that sequence. 
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